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Abstract — Identification of person by observing his/her 
walking style is referred as gait recognition. Gait as a biometric 
trait finds its applications in various automated controlled 
environments where authentication of a person at a distance is 
mandatory as a measure of security. The gait biometric has 
attracted the attention of computer vision research community 
from the past two decades. Many researchers have made an 
attempt to address the issues related to gait biometric and to 
propose a robust gait recognition system. In this research work, 
we made an attempt to propose a fusion based gait recognition 
system, which exploits the fusion of silhouette based gait 
features extracted from two different feature extraction 
techniques. An interval value based symbolic representation 
technique is explored to capture the variations of gait due to 
different covariates (change in cloth, carrying a bag etc). 
Extensive experiments are conducted on standard datasets to 
study the performance of the proposed gait recognition system. 

Index Terms — Axis of Least Inertia, Interval-valued 
features, Fusion, Subject, Symbolic representation, Matching, 
Identification. 


I. INTRODUCTION 

With the advance of science and technology, today we are 
living in the world of automation where most of our day to day 
activities are controlled and managed by intelligent machines. 
Any type of automation essentially demand some sort of 
security due to various types of threats in general. Computer 
vision plays an important role in many automation systems 
and, image processing and pattern recognition techniques 
have become indispensible components in such systems. 
Automated controlled environments such as banks, parking 
lots, financial institutions, restricted access locations, airports 
etc., require authentication of a person in particular as a 
measure of security. Conventional techniques such as identity 
cards and smart cards are being used for the purpose of 
authentication, but with some limitations. In order to 
overcome the limitations of conventional techniques of 
authentications, researchers and technicians are exploring 
efficient and effective techniques for person identification. 
The concept of biometric has attracted the attention of the 
researchers as an alternative way to person identification. 
Many types of biometric traits such as face, fingerprints, palm 
print, iris, retina, ear, and signature have been explored to 
provide more robust and accurate recognition of a person. 
However, there are certain situations where the biometric 
traits mentioned above are not feasible as they demand 
person’s cooperation, high resolution and other requirements. 
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In such situations gait biometric may be the choice as a 
supplementary biometric trait. Since gait is an individual style 
of walking, it can be captured at a distance without regarding 
to its resolution and cooperation of a person. It has been 
proved by the research community that the gait of a person is 
unique and can be used to identify a person at a distance. 
Identification of a person at a distance in restricted access 
areas gives the concerned authorities, a time frame to alert and 
react as a security measure before the person executes a 
crime, if he happens to be a criminal. 


II. Related Work 

Several attempts have been made by the researchers to 
provide a more robust and accurate gait recognition system 
from the past two decades. Some interesting works found in 
the literature in this direction are discussed below. 

AmitKale et al. [1] considered width of the silhouette of the 
image as features for gait recognition. Hidden Markov model 
is trained for representation of gait. Their approach has 
proved that the side-view has higher recognition accuracy 
compared to the frontal-view. Toby et al. [2] have proposed a 
method of capturing motion part and static part such as hand, 
leg and torso respectively through templates called motion 
silhouette contour templates (MSCT) and static silhouette 
template (SST). A simple NN classifier is used for 
classification. Jeevan et al. [3] have proposed temporal 
representation of Gait using Pal and Pal Entropy. The 
Principal component analysis was applied to the feature set 
extracted to create a feature matrix. They have used Support 
Vector Machine for classification of individuals and 
demonstrated the experiments on CASIA datasets A, B, C. 
Pose Energy Image and Pose kinematics features which 
captures shape and dynamics information respectively was 
introduced by Aditi Roy et al [4] . PC A and LD A techniques 
were applied for dimensionality reduction and to extract 
discriminative features. Optical flow features were considered 
by Chih-Chang et al. [5] for gait classification. They have 
considered only optical flow information without shape or 
other information. Three types of optical flow algorithms such 
as Lucas-Kanade, Horn-Schunk and Multi-frame are used by 
them. PCA is used to reduce the dimension of the feature set 
and simple NN classification technique was used for the task 
of classification. Experimentations were conducted on 
CASIA and on their own database. Sadaf Asif et al. [6] have 
drawn three bounding box around contoured human 
silhouette. 1) Upper part for arms movement. 2) Middle part 
for thigh and knee angles. 3) Lower part for legs movement, 
knee and ankle angles. Thigh, knee, ankle angles and 
bounding boxes widths are used as gait signatures. SVM 
based training and identification was performed using the 
extracted gait features. 
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It is evident from the literature that the gait of an individual 
person varies due to change in cloth, change in shoe, change 
in surface, carrying a bag etc. Also it has been observed that 
there will be some variations even in normal walking 
condition at different point of time. The conventional data 
analysis techniques may fail to capture such variations 
effectively. From the literature survey, we understand that the 
concept of symbolic data analysis has been well studied in the 
field of cluster analysis [7-12], shape analysis [13] and 
signature biometric applications [14]. Also suitability of 
symbolic data analysis approach for gait recognition is 
attempted recently in [15-18] and in [19] to be published. 
These unconventional techniques have proved that they 
outperform the conventional techniques in terms of 
performance. Thus, we propose to incorporate the concept of 
symbolic data analysis particularly the interval type data to 
capture the variations and to effectively represent the gait 
information in the knowledge base used for the purpose of 
recognition. It is also observed from the literature survey on 
biometrics that the techniques of feature level fusion and 
decision level fusion is studied to enhance the performance of 
the biometric systems. With this backdrop, in this research 
work, we have proposed the fusion based gait recognition 
system, which exploits the fusion of silhouette based gait 
features extracted from two different feature extraction 
techniques. Performance of the proposed gait recognition 
system is studied by conducting experiments on the CASIA B 
gait databases. Rest of the paper is organized as follows. 
Section III presents proposed methodology for gait 
recognition. Experimental results are presented in section IV, 
followed by comparative analysis in section V and conclusion 
in section VI. 


III. Methodology 

The proposed method of gait recognition system involves 
three main phases i.e., (i) Fusion of silhouette based gait 
features extracted from two different feature extraction 
techniques [15,16]. (ii) Symbolic representation of fused 
features and (iii) Matching and recognition. Input to our 
proposed methodology is a sequence of silhouettes of a gait 
cycle. A gait cycle is a basic unit of gait and it refers to the 
time interval between successive instances of initial 
foot-to-floor contact for the same foot [1]. We have assumed 
that the speed is constant within any specific subject gait 
sequence cycle (length of different instances of a subject like 
change in viewing angle, change in cloth type, carrying a bag 
is constant). However, speed could vary among reference 
(training) and probe (test) sequences. The following 
subsections provide the detail descriptions about the proposed 
methodology. 

A. Method- 1: Extraction of direct features 

A gait characteristic depends on the variations in the shape of 
the body contour overtime and most of the distinguishing 
information lies in the leg arm region [20-21]. It can be 
observed from a gait cycle that there will be changes in height, 
width and in step length of human walk. These variations 
differ from person to person and found to be unique among 
different subjects. Therefore, we have extracted three 
prominent temporal features, such as height, width and step 


length directly from a silhouette during walk of a subject in 
one gait cycle. Also, we have considered ratio of height to 
width as one of the feature. Fig. 1 shows an example of gait 
silhouette and the features extracted to characterize it. The 
distance between A and B is considered as height of a gait 
silhouette and is denoted as dl, similarly, the distance 
between C and D is considered as step length and is denoted 
as d2, distance between E and F is considered as width and is 
denoted as d3. Besides these three features, the ratio of height 
to width i.e., dl/d2 is also considered as feature and is denoted 
as d4. Thus the feature vector DF = {dl, d2, d3, d4} of 
dimension four is used to describe the gait silhouette in this 
method. 


A 



B. Method-2: Extraction of indirect features 

In this method, axis of least inertia of a gait silhouette is 
exploited to extract features to characterize the gait. The 
shape of a gait silhouette changes during a gait cycle and this 
changes is captured by the use of axis of least inertia [22] . The 
orientation of the axis of least inertia depends on the gait 
silhouette and is found to be unique. Since, the shape of a gait 
silhouette changes during a gait cycle, the orientation of the 
axis of least inertia also changes. Thus, the slope angle (0) of 
the axis of least inertia of a gait silhouette is considered as one 
of the prominent feature to characterize the gait. It is also 
observed that, the length of the axis of least inertia of a gait 
silhouette and its centroid changes during a gait cycle. 
Therefore, the distance (Dl) between the centroid (C) and the 
extreme point El of the axis of least inertia is computed and 
considered as a feature value. Similarly the distance (D2) 
between the centroid (C) and the extreme point E2 of the axis 
of least inertia, the horizontal distance (D3) between the 
centroid (C) and the extreme left point on the gait silhouette 
(L) and the horizontal distance (D4) between the centroid (C) 
and the extreme right point on the gait silhouette (R) are 
captured as feature values. Thus, the feature vector IF = {Dl, 
D2, D3, D4, 0} of dimension five is used to characterize the 
gait silhouette in this method. Fig. 2 shows an example of gait 
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silhouette with axis of least inertia and the points considered 
to extract the features. Since, the features extracted in this 
method depends on the axis of least inertia of a gait silhouette, 
we refer these features as indirect features. 


El 



Axis of least muftis 



Fig. 3 Silhouettes with different covariates 


Let Sj - js 7 , Sj , • • • , sj ,• • •, Sj } 


( 2 ) 


be the n instances (change in clothes, carrying conditions and 
different normal conditions) of the subject Sj . Let Tj be 
the length (i.e., total number of silhouettes in a gait cycle of / h 
instance) of instance S j . Tj is same for all S j (j=l,2,....n) 

but Tj could vary for different subjects, i.e., Sj (/ = 
1,2,. . .AO- Let m be the number of features extracted from t th 
silhouette of an instance sj of subject Sj and is given by 


Fig. 2 Silhouette with axis of least inertia 

C. Fusion of gait features 

It is quite meaningful to combine the features extracted from 
two or more different techniques to study the performance of 
any biometric system. Thus, in this work, we propose to fuse 
the features extracted from the two methods as described in 
the previous sections. A simple concatenation operation is 
performed on the feature vector to produce the combined 
feature vector. So, in general terms, Let DF = {dl, d2, d3, d4} 
be the four-dimensional feature vector describing gait 
silhouette according to method- 1 and Let IF = {Dl, D2, D3, 
D4, 0} be the five dimensional feature vector describing gait 
silhouette according to method-2. The fusion of these two 
feature vectors is given by FF = {dl, d2, d3, d4, Dl, D2, D3, 
D4, 0} which is of dimension nine. So, to make it more 
general and convenient for representation, we denote the 

fused feature vector as F = {fl, f2, f3, , fm} where m = 

9. 

D. Symbolic Representation of Gait 

Effective representation of the extracted features makes the 
recognition system more robust and effective. Since the gait 
of a same person varies at various instances (covariates) like 
carrying a bag, wearing different clothes, different normal 
conditions etc, and these variations are handled by 
consolidating the features in the form of an interval type data. 
Fig. 3 shows the t th silhouette of a subject at various instances 
(covariates). 

Let S = {S l ,S 2 ,...S I , S N } (1) 

be the N number of subjects. 


j/(0 = {//i(0,// 2 (0, -fiiit)} (3) 

Where t denotes the particular gait silhouette in a gait cycle. 
The vector representing the features of all the Tj silhouettes 
of sj is given by 

si = fc,F/ v F/ 2 ,....F/ n .Ff T \ (4) 

Where Fj t = sj (t) and Tj is the number of silhouettes 
of sj . The minimum and maximum value of the k th feature of 
t th silhouette of all the instance of Sj is given by 

fi (0 = min (fl (0, fl (t). fi (0, .fi «) (5) 

fi W = max (fl (0, fl (/). fi «, fl «) (6) 

The reference sequence of a subject Sj (/ = 1 ,2,. . . ., N) in the 
knowledge base is thus represented in the form of an 
interval-valued type symbolic feature vectors as 

F,t) ( 7 ) 

Where Tj is the number of silhouettes of a subject S j 
and 

F„ = !/n it ) , fl (f )] , [/,2 (0 , fl (f [fl (0 - /» M , /to ©I (8) 
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Where each k ih feature f Ik (t) and f^ k (t) are obtained as 
shown in “(5)” and “(6)” respectively. 

The probe sequence of an instance of subject Sj of m features 
to be tested is represented as crisp feature vector and is 
denoted as S p and given by 

.S p = |7' p , PF,,PF 2 , PF„ PF t } (9) 

Where T P is the length of probe sequence (total number of 
silhouettes in a gait cycle of probe sequence) and 

PF t ={fi (0,/ 2 (0, (10) 

Table I shows the features representing the t th silhouette of 
different instances (covariates) of a subject Sj and the 
corresponding symbolic features in interval -valued form. An 
example of feature vector values (of type crisp) of a t th 

silhouette of probe sequence S p is shown in Table II. 

E. Gait Matching and Recognition 

In order to recognize a probe sequence S p , the features are 

extracted from the probe gait sequence using the techniques 
discussed in the section III A and III B. The extracted features 
are then fused as described in section III C and the fused 


which the f k (t) value is closer to either lower limit 

f Ik (0 or the upper limit ff k (0 . \T p —Tj | is computed and 

subtracted from total similarity value, when the Probe and 
reference gait sequence are not equal. The similarity between 

the probe gait and reference gait of all the subjects S j (/ = 
1,2... A) in the knowledge-base is computed and is used at 
the time of identification as discussed in section IV. 

IV. EXPERIMENTS AND RESULTS 

In order to study the performance of the proposed method of 
gait recognition, four experiments were carried out on CASIA 
B dataset [24] . The gait silhouettes used are in 90° (side view) 
viewing angle, as this view provides more gait information 
than the silhouettes taken from other view angles. The CASIA 
B dataset consists of 124 individuals (subjects) with three 
covariates such as view angle, carrying condition and wearing 
coat. Each subject consists of 10 series, out of which 2 series 
are walking sequences carrying a bag, 2 series are walking 
sequences wearing different clothes and 6 series are in normal 
conditions. We have measured the performance of the 
proposed approach to gait identification using cumulative 
match scores (CMS) [25]. 


Table I : Example of crisp feature values and the corresponding interval -valued features representing t th silhouette in each covariate of a gait cycle of 
combined features 


Covariates 

a 

i 2 

fi 

f* 

fs 

f6 

p 

fs 

p 

Bagl 

130 

39 

69 

1.88 

41.01 

36.00 

9 

8 

0.82 

Cloth 1 

131 

41 

70 

1.87 

35.01 

33.01 

10 

13 

0.92 

Normal 1 

129 

38 

69 

1.86 

37.01 

35.01 

7 

10 

0.98 

Normal2 

128 

40 

70 

1.82 

39.01 

36.01 

8 

12 

0.93 

Normal3 

130 

37 

68 

1.91 

36.01 

36.00 

7 

11 

0.97 

Interval type 
values 

[128, 131] 

[37,41] 

[68, 70] 

1.82, 1.91] 

[35.01,41.01] 

[33.01,36.01] 

[7,10] 

[8,13] 

[0.82, 0.98] 


feature vectors are used to represent the probe gait sequence. 
It is noticed that the probe gait sequence is represented by a 
set of crisp feature vectors as the probe gait is in any one of the 
covariates mentioned earlier. Now, the crisp feature vectors 
of the probe gait sequence are matched with the symbolic 
feature vector of the reference gait sequence stored in the gait 
knowledge base. The Similarity measure proposed in [23] is 
used to compute similarity between reference sequences and 
probe gait sequence. 

TotalSimilarity(s p , 5 ,)=| £ £ «])] - ^ P -T,\) ( 11 ) 

\t = 1 k = 1 J 

For I = 1 to N 

Where 


Tabla II : Exacopls of critp faatura values of a silhouette of probe 
sequence 


Feature No. 

Features 

TVarwr# of probe 

seq uettce (crisp values) 

1 

n 

131 

2 

n 

3E 

3 

p 

69 

4 

p 

189 

s 

p 

36.01 

6 

p 

35.01 

7 

p 

E 

8 

p 

10 

9 

tt 

0.9S 




if ( fk (0 ^ f ik (0 and fk (0 ^ fik ) 


1 


1 +fk(t)-fi~ k (t) 1 +/*(*)- / ft + (0 


( 12 ) 


When f k ( t ) lies between the interval, the similarity value 
will be 1 otherwise, similarity value depends on the extent to 


A. Experiment I 

In this experiment feature level fusion with the training set 
composed of different covariates are considered. First series 
of carrying a bag named as B1 (bagl), first series of coat 
named as Cl (cloth 1) and first three different normal walking 
series named as N1 (normal 1), N2 (normal2) and N3 
(normal3) are used for training. Second series of carrying a 
bag named as B2 (bag2), second series of coat named as C2 
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(cloth2) and rest of the series of normal walking are named as 
N4 (normal4), N5 (normal5) and N6 (normal6) are used for 
testing. Table III shows the identification rate of the proposed 
methodology at rank 1, 5 and 10. The Cumulative Match 
curve for the proposed system in Fig. 4 shows that the 
performance at rank 1 is the correct classification rate (CCR) 
and we have achieved average CCR of 88.65%. 

Table III : Identification rates at different ranks -in the 
proposed approach 


Probe 

Identification 


1 

S 

10 

N4 

94.16 

100.00 

100.00 

N5 

96.66 

1 00.00 

100.00 

N6 

93.33 

100.00 

100.00 

C2 

SO . S3 

96.66 

9E.33 

B2 

7B.30 

91.66 

96.66 

Average CCR 

EE, 65 




CumJrtm it Kdi x=zn 



Fig. 4 Cumulative Match Score 
B. Experiment II 

In this experiment feature level fusion with the training set 
composed of same covariates such as normal walking are 
considered. In the experiment, only first four different normal 
walking series named as N1 (normal 1), N2 (normal2), N3 
(normal3) and N4 (normal4) are used for training. Other two 
series of carrying a bag named as B1 (bagl), B2 (bag2), two 
series of coat named as Cl (cloth 1) and C2 (cloth2) and last 
two different normal walking series named as N5 (normal5), 
and N6 (normalb) are used for testing. Table IV shows the 
identification rate of the proposed methodology at rank 1 , 5 
and 10. The Cumulative Match curve for the proposed system 
in Fig. 5 shows that the performance at rank 1 is the correct 
classification rate (CCR) and we have achieved average CCR 
of 79.30%. 


Table IV : Identification rates at different ranks in the 
proposed approach 


Probe 

Idenlifice. don. raised 



1 

5 

10 

N5 

97.50 

100.00 

100.00 

N6 

95.83 

100.00 

100.00 

Cl 

69.16 

7B.30 

B6.66 

C2 

64.16 

71.66 

B0. S3 

B1 

76.66 

83.33 

90.00 

B2 

72.50 

79.16 

90. E0 

Average CCR 

79.30 




Cu nr_B av* it a rt : 



C. Experiment III 

In this experiment score level fusion with the training set 
composed of different covariates are considered. The training 
and testing set is same as in the experiment I. Table V shows 
the identification rate of the proposed methodology at rank 1 , 
5 and 10. The Cumulative Match curve for the proposed 
system in Fig. 6 shows that the performance at rank 1 is the 
correct classification rate (CCR) and we have achieved 
average CCR of 88.99%. 

D. Experiment IV 

In this experiment score level fusion with the training set 
composed of same covariates such as normal walking are 
considered. The training and testing set is same as in the 
experiment II. Table VI shows the identification rate of the 
proposed methodology at rank 1, 5 and 10. The Cumulative 
Match curve for the proposed system in Fig. 7 shows that the 
performance at rank 1 is the correct classification rate (CCR) 
and we have achieved average CCR of 79.85%. 


Tabk V : Identification rates at d if ta ra n t ranks in the proposed 
approach 


Probe 

Identification. 


1 

5 

10 

N4 

94.16 

100.00 

100.00 

N5 

96.66 

100.00 

100.00 

N6 

93.33 

100.00 

100.00 

C2 

B0. S3 

95. B3 

99.16 

B2 

B0 .00 

93.33 

9B.33 

Average CCR 

SB .99 




Cut _ xr.tirr udi ;i “ ■» 



Fig. 6 Cumuktive Match Score 
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Tab 1 -e VI : Identification rates at different ranks in the 
proposed approach 


Probs 

Id&nlifie£i£iiS?n. mis/} 



1 

5 

10 

N5 

97 .50 

100.00 

100.00 

N6 

95. S3 

100.00 

100.00 

Cl 

70. 80 

80.00 

E6.66 

C2 

65.00 

71.66 

El. 66 

El 

77.50 

85.00 

94.16 

E2 

72.50 

80.00 

90.80 

Av erase OCR 

79 M 




the knowledge base remains same and does not change either 
for training set with same or different covariates for given 
number of subjects. Also, the time required in retrieving the 
data from the knowledge base during matching of training set 
(same or different covariates) with different probe set remains 
same and does not change (except with increase of subjects in 
the database). Thus the symbolic approach way of 
representing data in the interval form in the knowledge base 
reduces the storage and time complexity and increases the rate 
of recognition. 


Cuniki-i mrti xt=ni 



VI. Conclusion 

In this paper, performance of the feature level and decision 
level fusion strategy for gait recognition is studied. Silhouette 
based gait features extracted from two different techniques 
are fused. Effectiveness of different covariates and similar 
covariates at the time of training is demonstrated. Efficiency 
of interval value based symbolic representation technique is 
assessed. Experimental results conducted on the CASIA B 
data set have proved that the proposed fusion strategy has 
yielded significant improvement in the overall recognition 
rate. 
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